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Signal Enhancement 

blast General Statement: 

We interpret a signal as measurements made according to one or many it logical 
measurement devices. If there are many devices it is assumed that each is concerned with a 
local connected part of the signal. It is assumed that the units each device measures differ 
across time, and if there is more than one device per signal, across the signal. However, it 
is assumed that all measurement units are related to one another by linear transforms. For 
a given, set of measurements, standard coordinates are defined by a linear combination of 
the measurements. For example, Z-scores (one particular standard coordinate) are 
calculated by subtracting the mean from the measurements ' and dividing by the 
measurements standard deviation. Standard coordinates have the property that they are 
invariant to linear transforms, fiy calculating standard coordinates, the signals measured 
(either across time or location) are transformed to the same units. 

A Domain of application: Imaging 

We propose that standard coordinates are particularly useful in imaging. Let i(x,y) denote 
an image brightness at location x and y. The logarithm, of the image response is denoted 
i(x,y). The brightness and contrast of I can be changed by a linear transform if i: i(x,y) - 
mi(x,y)+b where m and b are scalings. The brightness term b scales the brightnesses in an 
image (b is a. multiplicand in non-log space) and accounts for changes in the overall 
brightness of a scene. I n terms of a trichromatic camera where the signal is composed of 
red-, green- and blue- records we have 3 images; R(x,y), G(x,y) and B(x,y) and there might 
be 3 individual brightness factors. For example the move to a bluish light from a yellowish 
one might be modelled by large blue- and small red- brightness factors. The contrast term 
m accounts for the number of log-units available. Consider taking a picture outside where 
the signal range is 100000 to 1. In contrast a photographic reproduction might have a 
signal range of 100 to 1, a shift in log-units of 5 to 2. Coding an image in terms of standard 
coordinates calculated for i(x,y) 
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e.g. 

t 

(p and cr denote mean and standard deviation) 

has two main advantages. First, it is invariant to // and b (so the z-scores for the 
photographic image and the outdoor signal are the same). This invariance might be useful 
for recognising signal content. Second, an image is recast in a way which makes sense in 
terms of our own visual perception. We as people see scenes with high dynamic ranges 
(100000 to 1) yet such a high dynamic range is not used in the cortex. Rather, areas in an 
image with widely different signal ranges are recoded it into the same units. For example, 
the physical units' in shadows and highlight regions are small and large respectively. Yet, if 
the image is coded in (local) standard coordinates the shadow units will become relatively 
bigger and the highlight coordinates relatively smaller. The import of this is that we can 
see into shadows and into highlights. This tallies with our experience as human observers. 
Recoding images in terms of standard coordinates provides an elegant solution to a signal- 
processing problem which our own visual system must contend. 

Aspects of the present invention provide a method for signal enhancement by standard 
coordinates. 

Aspects of the present invention alternatively provide methods of handling signals as 
described in the various examples, 

Introduction 

First, let us imagine the following experiment. Three scientists measure the temperature of 
a substance as various forces and stresses are applied to it Data is compiled which 
simplistically measures temperature against amount of stress applied (we might imagine 
that higher stresses would lead to higher temperature) where the same stress is applied 



3 



many tunes. The scientists now wish to compare their results. But, there is a problem: 
scientist-1 has measurements in Kelvin, Scientist-2 in Celsius and Scientist-Sin Fahrenheit 
How can the scientists compare their data? Of course, the answer is simple: we look up a 
reference book and find the formulae that map temperatures across scales. For example, 
Fahrenheit is mapped to Celsius according to: C=0.56F-17.78 and Kelvin to Celsius: C=K- 
273.2. Note that the correction in each case is linear. Let us now consider linear corrections 
m terms of images (but the reasoning extends to general digital signals). Let (R,G,B) 
denote the red, green and blue value recorded in a digital "image. These values typically 
drive a reproduction process such a monitor or a digital printer. It is well known that, to a 
good approximation, many colours are adequately represented by the amounts of red, green 
and blue present (see [1]). It is - important to realise that the RGBs that drive picture 
creation are often representations of the world (e.g. a digital image). Moreover, in 
reproduction we often make adjustments to the image so they look' better or have 
particular signal properties. These two observations (that the signal is a measurement of the 
world and we might change these measurements) are important considerations. Suppose 
for example that we take a picture of a white surface under a whitish light. The 
corresponding RGB=(U,1) (white is equal redness, greenness and blueness). Now we 
alter the ffiuminant so it is yellower and now record (2,2,1) which is a yellowish colour. 
Mathematically we might summarise this as: 



1=> 2*1 = 2 

1=>2*1 = 2 ^ 
1=>1*1 = 1 



Remarkably, the multiphcands 2,2 and 1 in (1) will map all image colours from whitish to 
yellowish light [2J. In general RGBs can be mapped across illuminants according to: 



R=>pR 
G=>yG 
B=>/3B 



(2) 



Each scaling factor controls the brightness of image. measurements. 



Let us now imagine that we take a picture of a scene where there is a pronounced shadow. 
When we view the picture on a monitor we discover that we cannot see any detail in the 
shadow: everything is too dark. Assuming that the signal that drives the monitor is between 
0 and 1 we can stretch the dark values (at the cost of compressing the bright values) by 
applying a power function less than 1 (say a): 

R=>R a 

G=>G a (3) 
B=>B a 

Moreover, each color channel might have a separate power term applied. It useful to think 
of the power term as changing the contrast in an image (the relative importance of bright 
and dark values). Combining (2) and (3) we see that: 

R=> pR a 

G^>yG a - (4) 

B^> j3B a 

To first approximation, two images of the same scene but captured with respect to different 
viewing conditions and altered to drive different reproduction processes or to account for 
personal colour preference will be related according to (4). The easiest way to change the 
look and feel of an image is to change its brightness and contrast. As stated the relations in 
(4) are non-linear. However, taking logarithms of both sides reveals a natural linear 
structure: 

]nR=>lap + ahiR 

lnG^In^ + alnG 1 (5) 
kLB=>kij3 + ahiB 

In spirit Equation (5) relates rather nicely to the temperature experiment described at the 
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start of this document. The RGBs on the left hand side of are analogous to measurements 
made by one scientist and those on the right hand side are measurements made by a second 
scientist. If we know what we are measuring then it is easy to transform coordinates from 
one side to the other. Indeed, in the colour world it is now possible to calibrate (map 
coordinates to a reference measurement space) colour devices such as cameras, scanner; 
printers and monitors [3]. One implication of this is .that if we know how to produce a good 
looking image for a reference set of viewing conditions, it should be possible, in principle 
to produce a good looking image for all conditions. We simply map our image to the' 
reference conditions. Indeed, in a studio environment we can follow this modus operandi 
• and take a picture of a known reference chart (such as a Macbeth Colour Checker [4]) We 
then map the colour chart RGBs so that they look 'correct'. Applying the samecorrection to 
the rest of the picture should deliver a good-looking image. Of course the process is in fact 
more complex than that. For example, we would be foolish to remove the reddish 
appearance of colours at sunset (in order to remove colour bias due to illumination) 
because people like to see the sunset colours. This said, the idea that one can calibrate 
using reference information is widely used in color imaging and win provide satisfactory 
results much of the time. 



What do we do if calibration is not possible? 

Returning to me scientists and their temperature measurements. Suppose it transpires that 
not only are me units that were measured different but the equipment that was used was 
unrehable. Specifically, each of the three scientists used measurement devices that had 
been lying around the lab for some time and the accuracy of their measurements could not 
be guaranteed. To a first approximation the measurements (whether in Fahrenheit, Celsius 
or Kelvm) are a linear combination from where they ought to be. Though, in the case the 
linear combinations are not known. For example might write: TrueCelsius = 
A'MeasuredCelsius+B where A and B are not known. Of course by measuring the 
temperature of known physical processes (e.g. the boiling and freezing point of water) we 
could solve for A and B. Alas, and I hope the reader will bear with me here, me scientists 
earned out their experiments some time ago and there is no guarantee that should they 
calibrate their instruments now that their calibration would have any bearing on their 



previous results. So, given such unfavourable conditions can anything be done? Well 
something can in fact be done assuming that the scientists wish to answer particular kinds 
of questions. Suppose the scientists are interested in determining whether histograms of 
recorded temperatures(in each of the three experiments) have the same shape. Figure 1 
shows the temperature distribution in Celsius for two of the experiments (suppose one set 
of measurements were made in Fahrenheit and then converted to Celsius). Clearly the 
histograms look similar in shape. 

Moreover, the main difference between them would appear to be a small shift and a small 
stretching. To see if this is the case, we can map the temperature measurements to so called 
z-scores (one example of a standard coordinate). Let us linear transform temperature 
according to: 

C=aT+b (6) 

Let us choose a and b such that the mean of C (//(Q) is equal to 0 and the standard 
deviation of C (c<Q) is equal to 1). The mean and standard deviation of a set of N 
measurements are equal to: 



N // 



MQ- J ± r .*(Q-y* ^ GO 



where it is understood that standard deviation measures the spread of a distribution from 
the mean (a large standard deviation implies a large spread of measurements and a small 
standard deviation a small spread). It is straightforward to show that 



a= _j_ b= m. ( 8 ) 

cr(C) cr(Q 



and so 
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c-<r-*ro>. (9) 

cr(Q ( 9 > 

In Figure 2 below we show the two distributions shown in Figure 1 where we have mapped 
the temperatures to standard coordinates according to (9) (where each distribution is 
mapped separately). Thus Figure 2 indicates the histograms of Z-scores for the two data 
sets are the same.(this indicates the underlying distribution of data differs by a linear 
transform) 

Clearly the distributions are the same and so some inferences can be made e.g. the number 
of small and large measurements are the same for both experiments. However, it is 
important to realise that mapping to z-score standard coordinates is not a panacea it is not 
and cannot be as powerful as carrying out a full calibration. It is easy to convince yourself 
of this. Simply take 10 numbers and calculate the standard coordinates according to (9). 

Now add a second 10 numbers to the distribution and recalculate the standard coordinates. 
• Now, because the mean and standard deviation of the data will have changed so too must 

the standard coordinates for the original 10 numbers in the dataset. Returning to the image 
• - exampte- we can see" that equation (5) states that the" log RGBs" mm'imSge'sW.it linearly 

according to brightness and contrast From the foregoing discussion it should also be clear 

that the standard coordinates calculated for image RGBs are independent of brightness and 

contrast. Denoting In Xas x 

(r~fi(r)) Q + ar + or)) 
o-Cr) a(p+ar) (10 > 

Henceforth we adopt the convention that lower case letter denote logarithms. 

We propose that (10) is a useful representation for image processing. Not only have we 
discarded unknowns (brightness and contrast) but we have done so in way which is 
intuitive. Let us consider the challenges we ourselves face when we look out at the world. 
When we look at a scene we are confronted by the same image processing challenges that a 
camera faces. For example, we may see a boy sitting under a shaded tree on a sunny day. 



The physical signal reaching our eye is on the order to 100000 to 1 (bright sunlight to 
shade). Yet, there is no evidence that such a wide it dynamic range is encoded in the visual 
cortex. Rather we need to adopt strategies for encoding images with a smaller dynamic 
range. One way to do this, and this is the main inventive step, is to recode RGBs in terms 
of standard units. That is we transform image measurements so they are independent of 
brightness and contrast. In general we will wish to carry out the normalisation locally. It is 
easy to see this makes intuitive sense. A bright pixel seen in the context of other bright 
pixels may be coded as say 3 standard units above the mean. Similarly, a dim pixel seen in 
the context of other dim pixels may also be 3 standard units above the mean. That is, two 
very different physical measurements may, in principle, be coded as the same number and 
appear equally bright after coding. In practice, standard deviations would probably be 
calculated across an image with proximate pixels being more important than those far 
away. So long as the weighting functions are chosen sensibly, bright areas of the image 
will, overall, appear brighter than darker ones. Though detail will certainly be drawn out in 
the shadows and the highlights. The details of the standard coordinate approach are 
presented in section (3).In section (2) we present a brief overview of relevant research. A 
particular embodiment of the invention is presented in section (3). 



Background 

Coding images ready for display is a huge research and applied problem (See for example 
the proceedings of the colour imaging conference (for years 1993 through 2002). Finding 
the p, /and J3 scalars of Equation (2) is usually called colour constancy and this alone has 
spawned (literally) hundreds of papers [5,6] for a review of the major approaches. 
Determining the contrast is more problematic and their are few papers which explicitly set 
out to recover the power term a in (5). Though, recently the current author has considered 
how power term invariance might be achieved [13]. 

The questions of contrast and brightness are often implicit in algorithms for image 
enhancement and dynamic range compression. These algorithms like (5) tend to work in 
log space but to either consider brightness or contrast but never both. To understand how 



mese algoritbms work it is useful to define some notation and two simple image 
transformations. 

First let rfry) denote tbe log response at location (x,y) in an image for colour channel 
k=R,G,B. Second, let us define a coordinate transform from rgb to Luminance l(x,y), Red- 
Greeness rg(x,y) and Yellow Blueness yb(x,y): 

K^,y)=rR(x,y)+rc(x,y)+r B (x,y) 
r Six,y)=r l (x,y)-r G (x,y) (n) 

yb(x,y)^ R (x,y)+r G (x,y)-(2*r B (x,y)) 

Equations similar to (11) appear throughout the colour hterature (e.g. [1,8]). They are the 
so-called 'opponent- colour channels: / is a measure of white-black (loosely brightness) rg 
is a measure of red and green (in opposition) and,* is a measure of yellowness blueness 
(in opposition). Two technical observations are important here. First, in the discussion 
below I will refer to the above equations as opponent channels. Yet, in truth there are many 
ways of calculating opponent channels (the precise equations above may not be used in the 
methods cif^rSecohd,(iiT is a set'of Im^^atibns" and" ffHTff is poss^Tta 
compute r,g and b from /, rg and yb (the equations are reversible). Equation (1 1) is useful 
because it allows the separation between the achromatic or Luminance (/) and chromatic • 
signal (rgyb) of a colour (if we multiply an RGB by a scalar x only / will change!). Some 
algorithms for dynamic range compression seek only to change the achromatic aspect (/) 
keepmg the chromatic aspect unchanged. 



/Subtracting the mean cancels brightness 



From (5) we see that a change in brightness is modelled by an additive term in log space 
Smce all pixels have the same" additive shift it follows that the mean colour response is also 
perturbed by this shift As such subtracting the mean removes dependence on brightness 
Denoting aQ as a function which calculates the local mean (or average) it follows that 
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r&,y)-a(rfay)) (11) 
is independent of brightness. 

II Subtracting the maximum cancels brightness ■ 

From (5) we see that a change in brightness is modelled by an additive term in log space. 
Since all pixels have the same additive shift it follows that the max colour response is also 
perturbed by this shift. As such subtracting the maximum removes dependence on 
brightness. Denoting MO as a function which calculates the local maxima it follows that 

r&c,y)-M(r£c,y)) (12) 

Equation (12) is independent of brightness. 

Algorithms for Dynamic Range Compression/image enhancement) 

1) NASAs multiscale retinex (MSR) 

This algorithm [9] discounts local brightness in the R, G and B colour channels. Operator I 
above is used with the local averaging operator L() defined as the sum of three Gaussians 
(giving quite a smooth averaging operator). Contrast is not explicitly considered though, 
certain global adjustments are made. 

Comments: Because the local average is subtracted it is common for images to look 
desaturated (or greyish). This problem resulted in an adhoc (and unsatisfactory) 
resaturation phase. Examples of MSR performance can be seen at www.truview.com . 

2) Luminance modified MSR 

This algorithm discounts local brightness in the / achromatic channel with the chromatic 
channels rg and yb undergoing a global adjustment [10]. J above is used with the local 
averaging operator aQ defined as the sum of three Gaussians (giving quite a smooth 
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averaging operator). The same filtering was used as for the MSR case. 

Comments: There was no real improvement observed over the original MSR method 
Indeed, the authors of this algorithm suggested that a global adjustment might work 
equally well. 

3) Retinex 

Edwin Land and John McCann have developed many variants (e.g see [11,12,13]) of this 
algorithm over many years. In spirit U describes their approach. However, their definition 
of local maximum is highly complex (being non-linear and iterative). When Retinex works 
well it can generate pleasing images. Compared to MSR Retinex works better as 
subtracting the local maxima tends to keep colours looking as they should look (there is no 
desaturation problem as with MSR). Unfortunately, when Retinex fails it tends to do so 
quite badly. 

Comments: No real mention of the power function is made. Though, there is the need to 
render the output values by an appropriate look up table. To all intents and purposes this 
= might be a power function. Though, to my knowledge this has never been defined in the 
literature. 

4) Modified Retinex 

Because the local maximum function is complex there are many variants which provide 
variants. Worth mentioning are the works of Brainard and Wandell [14] (which presents a 
framework where / and IT might be used), the algorithmic work of Funt et al [15] (which 
provided the first 'accredited' algorithm) and recent work by Sobel and McCann [16] 
(which modifies the definition of local maxima to take account of overly large local' 
changes in an image). One of the advantages of Retinex is that it is based on 
psychophysical observations made with human observers. More recent work by Spitzer 
[17] has carried on this approach and has presented an operational model of visual 
processing that appears to solve some brightness and contrast problems. However, that 
approach is based on what is known about visual processing and not on what the problem 
is that needs to be solved. Indeed, that is not discussed at all. Spitzer's work is also novel in 



that computation is carried out on all three opponent channels. Rather speculatively, Land 
also suggested a Retinex type computation might be carried out in opponent channels [1 8]. 

Comments: Retinex still has problems. The problem it is trying to solve has never been 
clearly articulated. Good results are only possible with user intervention. All retinex 
algorithm have free parameters which must be 'tweaked' on a per image basis. 

5) Non-linear Masking: 

In departure from previous methods Moroney [19] focuses on contrast and not brightness. 
In spirit if one divides a log response by its local average 

l(x,y)laQ(x,y)) (12) 

then contrast must cancel (if we change the contrast in an image the denominator and 
numerator are scaled by the same factor which cancels). The definition of a here is a 
Gaussian but with a very large standard deviation (so that local values are only given 
slightly more weight than far away values). Notice that calculation is carried out in a 
Luminance channel with the chromatic signal left unchanged. Moreover, as a technical 
note the Local average is calculated in a slightly different way than presented above 
(though for our'purposes the detail is not important) 

Comments: Non-Linear masking works surprisingly well. In part it does so because it is the 
least aggressive (choosing a Gaussian with a large standard deviation as an averaging filter 
means the definition of contrast is more global than local). However, it says noming about 
brightness and so cannot account for simple artifacts such as such as colour. 

The Invention (for images) 

We interpret an image as measurements made according different but unknown 
measurement devices (different coherent parts of the image' are measured by different 
devices). NOTE this is a logical assumption only. An image is captured by a single device. 
But, because we may wish to change the image units in different parts of the image (for 
example to alter the dynamic range) it is useful to think of the image as being a composite 
of measurements from a set of devices. It is assumed that the units each device measures 



differ from one another by a linear transform. Local linear corrections are made to the 
image effectively calculating standard coordinates across the image. Local standard 
coordinates are independent of brightness and contrast and are so resilient to these changes 
in an image. Brightness and contrast changes effectively account for most of the 
differences between (images of the same scene). Further, coding images in standard 
coordinates presents a plausible solution to an imaging problem that our own visual system 
must face. 

Standard Coordinates 

Let measurements be denoted Xi (« A ,») X= { X] , x 2 These coordinates are 

transformed linearly: y i =ax i ^b, 7= W2, Standard coordinates defined on X end 7 

are the same. Numerous standard coordinates (a standard coordinateis a linear transform 
which renders the data independent of brightness and contrast) might be calculated: 



Z-scores: 

s _ x, -fi{X) 

Max-min score: 



(13) 



- */-minpf) 
max(Z) - min(X) * ' 



Max-mean score: 
s _ x, -min(X) 



(15) 



To see that (13) work let X=l 0,20,3 0,40 and 7=10,30,50,30 (yf=2x r 10). Calculating(13) 
for^or 71eads to the set: -1.162, -0.3873, 0.3873,1.16. Calculating (14) former 7 leads to 



the set: 0,0.333,0.667,1. Calculating (15) forXor Y leads to the set: 0,0.5,1,1.5. Of course 
there are many other standard coordinate systems. The advantage of (13) through (15) is 
they are based on simple well understood statistical operators: mean, max and min. 



Calculating local standard coordinates 

By assumption we are assuming that an image can be thought of composed of a set of 
different regions and that each region has measurements in different units. It follows if we 
can standardise coordinates locally. 

Calculating the local Mean 

This is easy to do and the literature is replete with possible algorithms. The most common 
method is to convolve an image with an averaging filter such as a Gaussian. A Gaussian 
has large values near the origin and these decrease monotonically as a function of distance 
from the mean. To illustrate how the convolution works let [1,2,2,2,5,5,5] be a 1-d signal 
and [0.5, 0.5] an averaging filter. We simply place the averaging filter on top of the signal 
(at a given location), multiply the filter and the signal and sum up. This is repeated for each 
position along the signal. Operating in mis way we see that the output of the convolution is 
[1.5, 2, 2, 3.5, 5, 5].We need to make a couple of comments. First, notice that the edges(l 
to 2 and 2 to 5) have been diminished in scale. This is as we would expect if we locally 
average the image. Second, we began with 7 inputs but have only 6 outputs. The reason for 
this is that we haven't defined what we do at the boundary of the signal. In terms of 2- 
dimensionalsignals, we might assume that outside of the image everything is zero (these 
are called Dirichlet boundary conditions [20]. Or that the signal is not is constant at the 
boundary (Neumann conditions [20]).What needs to be done relative to each assumption is 
well understood (and is a detail). We implicitly assume this issue has been dealt with in the 
discussion below. If s(x,y) is a 2-dimensional signal (such as an image) and a(x,y) and 
averaging filter then convolution is defined mathematically as: 

M(x,y)= f\a(u,v)s(x-u,y-v)dvdu (16) 

U V 

where it is assumed J ja(u,v)dvdu = 1 



If s(x,y)-k(the same value ai aU locations) then the average of this signal should be 1. 
Calculating the local Max 

What does local maximum mean? Well one definition is that we could compute a local 
maximum say amongst all pixels within 5 pixels from location (x,y). We could denote mis 
M s {x,y). A maximum within a distance 10 could also be calculated: M, 0 (x,y). In general we 
might define a local maximum as: 



M(x,y) = -*L 



N 



N 



(17) 



where w t are weights that decrease as i increases and the sum of the weights is 1 . 

Note, it is important to realise that (17) is just one of many ways in which a local 
maximum might be defined. 

i 

Calculating the local Min 

As for the max case we could define a local minima function m^which returns at (x,y) 
the minima of all pixels within d pixels from (x, y). The local minima for an image would 
be defined as: 



N 



m(x,y) = J2— (lg) 



where again the sum of the weights is i. 



Calculating local standard deviation 

Standard deviation is described in Equation (7). This is the square root of the average of 
the squared deviation of the mean. Clearly, we might calculate this locally according to: 



<r(x,y)= i J \a{u, v)0 (x - u, y - v) - fi(x - u, y - v)) 2 dvdu (19) 

V u V 



where the averaging filter a() may be the same or different than that used for computing 
the mean. 

Calculating local standard coordinates 

In general we just substitute (16) through (19) in (13) through (15). For example the local 
definition of z-score is given below: 



or(x 9 y) 



Local min-max scores or min-mean scores are similarly simply defined. 
Experiments 

Figures (3), (4) and (5) outline a schema for processing an image. In summary we take an 
image, Convert to log-opponent coordinates then replace the Luminance signal by z-scores 
and then form an output image. The result are images where the detail in bright and dark 
regions are better balanced. Moreover, images generally look more pleasing. la detail the 
steps of this particular embodiment are: 



1) I(x,y) is and input image item 
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2) composed oiR(x,y), G(x,y) aaAB(x,y) (RGB color channels) 

3) taking logarithms gives: r(x,y), g(x,y) and b(x,y) 

4) we compute opponent responses according to Equation (1 1) 

5) we compute local estimates of the mean and standard deviationof the Luminance 
channel 

6) this is used to compute a z-score (20). Notice the red-green and blue-yellow channels 
have their contrast but not brightness adjusted (by the sigma for the luminance 
channel). Empirically we found that to get good looking images required similar 
contrast in each of the three channels. 

7) We invert (11) and solve for log R,G and B 

8) We can invert the logarithm and the images are ready for display. 

• While the processing pipeline' given above will generate images where detail is drawn out 
m ^ejmages, thejpipelineis not the inventive step. Receding the data as z-scores here (and 

• stanoard- coordinates m geneFal)' [step S mdS] uTnBW aM n6vei: The offieT part? of the" 
pipeline are however important especially if the aim is to produce pleasing images for 
display. However, the number of ways we might calculate opponent channels, standard 
coordinates etc are too many to enumerate. A user will craft the pipeline according to then- 
needs. But, the key enabling step is the standard coordinate calculation. On the left-hand 
side of Figure 6 are 3 input images and those on the right three grey-scale output images 
processed according to the schema described. While detail has been pulled out the images 
are arguably not very pleasing. Empirically we found that the precise definition of 
Luminance has an impact on the look image'. An alternate inversion where we invert (1 1) 
with the constraint that saturation is preserved (saturation is calculated in RGB and the 
input saturation equals the output saturation) leads to the grey-scale images shown in 
Figure 7. 




r 

Conclusion 

Signal processing systems such as ourselves are faced with the problem that they need to 
operate in conditions where the signal units are a-priori unknown. Li terms of images, we 
might observe a boy sitting under a shaded tree such that the difference in physical units 
between sunlight and shade is 100000 to 1. Yet, we do not have the capacity to work with 
such a large signal range. The proposed invention interprets signal as composites of 
measurements made by different devices (though, be clear hare only one device is actually 
used). We now consider that the difference between measurements is that the units used 
are different and unknown. By converting all measurements to standard coordinates we 
effectively enforce all devices to work in the same units. In terms of images this process 
enables us to account for changes in image brightness, dynamic range and contrast. The 
100000 to 1 signal can be recoded to (say) 100 to 1 such that we can clearly see the detail 
of the boy in the shade and also objects in direct sunlight. We can do this because locally 
in the image v/e are now using the same units. 
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